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ABSTRACT 


This  paper  deals  with  quantitative  aspects  of  camera  fixation  for  a static  scene.  In 
general,  when  the  camera  undergoes  translation  and  rotation,  there  is  an  infinite  number  of 
points  that  produce  equal  optical  flow  for  any  instantaneous  point  in  time.  Using  a 
camera-centered  spherical  coordinate  system,  it  is  shown  how  to  find  these  points  in  space. 
For  the  case  where  the  rotation  axis  of  the  camera  is  perpendicular  to  the  instantaneous 
translation  vector,  these  points  lie  on  cylinders.  If  the  elevation  component  of  the  optical 
flow  is  set  to  zero  then  these  points  form  a circle  (called  the  Equal  Row  Circle  or  simply 
EFC)  and  a line,  i.e.,  all  points  that  lie  on  this  circle  or  line  are  observed  as  having  the 
same  azimuthal  optical  flow.  A special  case  of  the  EFCs  is  the  Zero  Flow  Circle  (ZFC) 
where  both  components  of  the  optical  flow  are  equal  to  zero.  A fixation  point  is  the  inter- 
section of  all  the  ZFCs.  Points  inside  and  outside  the  ZFC  can  be  quantitatively  mapped 
using  the  EFCs. 

In  a set  of  experiments  using  simulated  as  well  as  real  data,  we  show  how  the  con- 
cept of  the  EFC  and  ZFC  can  be  used  to  explain  the  optical  flow  produced  by  points  near 
the  fixation  point,  and  to  explicitly  map  the  space  while  fixating.  It  is  also  shown  experi- 
mentally that  points  near  the  fixation  point  may  change  the  sign  of  their  optical  flow  as  the 
camera  moves. 


1.  INTRODUCTION 


Camera  fixation  is  defined  as  actively  controlling  the  camera  motion  so  that  a 

given  visible  point  in  3-D  space  (a  fixated  point)  is  constantly  imaged  to  the  same  point 

in  the  image  plane.  There  are  several  advantages  offered  by  fixation: 

1.  Determination  of  relative  range.  Because  the  imaged  position  of  the  3-D  fixation 
point  remains  constant,  the  point  results  in  zero  optical  flow.  However,  the  optical 
flow  arising  from  static  points  in  a 3-D  neighborhood  of  the  fixation  point  can  be 
used  to  easily  determine  whether  these  points  are  in  front  of  or  behind  the  fixation 
point  [4].  Also,  these  points  will  have  relatively  small  optical  flow  values,  allow- 
ing the  use  of  gradient-based  flow  extraction  methods  [9], [12], [14]. 

2.  Verifying  range.  If  the  range  of  a static  object  is  hypothesized  using  some 
methods,  then  this  range  can  be  verified  by  pointing  the  camera  optical  axis  at  the 
object  and  then  fixating  on  the  object  at  the  given  range.  If  the  optical  flow  of 
points  on  the  object  are  near  zero,  then  the  range  is  verified. 

3.  Detailed  analysis  of  objects.  If  a moving  camera  is  fixated  on  an  object  of  interest, 
then  this  object  will  be  kept  in  the  camera  field  of  view  for  a long  period  of  time, 
thus  allowing  detailed  analysis  of  the  object’s  properties.  Also,  multiple  views  of 
this  object  will  be  obtained,  resulting  in  a more  complete  understanding  of  the 
object 

4.  Increasing  resolution.  If  a moving  camera  is  fixated  on  a region  of  interest,  then 
the  camera  field  of  view  can  be  quite  narrow.  This  results  in  high  resolution 
imagery  and  allows  detailed  analysis  of  the  region. 

5.  Motion  compensation.  If  a camera  with  pan/tilt  mechanism  is  mounted  on  a plat- 
form that  is  moving,  then  by  fixating  the  camera  at  a very  distant  point,  the  cam- 
era will  have  no  rotation  in  an  inertial  coordinate  system.  This  is  a way  of  main- 
taining camera  orientation  in  an  inertial  frame  without  using  an  inertial  navigation 
system. 

6.  Maintaining  orientation.  Imagine  a camera  that  is  free  to  rotate  relative  to  a mov- 
ing platform.  If  the  platform  undergoes  mainly  rotation,  the  camera  may  fixate  for 
a short  time  on  a point  or  a feature,  then  "jump"  (saccade)  by  about  360  ° to  fixate 
on  the  same  point/feature  again,  followed  by  a second  "jump",  etc.  By  measuring 
the  orientation  of  the  camera  relative  to  the  platform,  valuable  information  regard- 
ing the  orientation  of  the  vehicle  in  3D  is  obtained. 

7.  Analysis  of  partially  hidden  surfaces.  If  an  object  of  interest  is  partially  occluded, 
it  is  possible  to  get  a more  complete  view  of  the  object  by  fixating  the  camera  at  a 
point  on  this  surface.  This  can  be  done  by  ignoring  points  or  objects  that  are 
closer  to  the  camera  (i.e.,  produce  high  values  of  optical  flow)  and  integrate  over 
time  points  that  are  close  to  the  fixation  point  (i.e.,  produce  low  values  of  optical 
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flow). 

The  most  general  form  of  fixation  arises  from  a six-degree-of-freedom  camera 
motion.  A specialized  and  simple  form  of  fixation  is  where  a camera  undergoes  transla- 
tion and  no  rotation.  In  this  case,  the  camera  can  be  thought  of  as  fixating  on  a point 
lying  on  the  line  through  the  camera  pinhole  point  in  the  direction  of  the  velocity  vec- 
tor. 

In  this  paper  we  quantitatively  analyze  the  case  where  a camera  fixates  on  a point 
in  3-D  space.  The  paper  begins  by  describing  the  coordinate  systems  that  are  used,  fol- 
lowed by  deriving  expressions  for  the  optical  flow  in  spherical  coordinates  for  six- 
degree-of-freedom  camera  motion.  These  equations  are  solved  to  find  sets  of  points  in 
3-D  space  that  result  in  equal  flow  values  (and  in  particular  zero  flow)  for  instantaneous 
camera  motion.  In  the  case  where  the  rotation  axis  is  perpendicular  to  the  translation 
vector,  the  equal  flow  points  form  circles  and  lines  at  each  instant  of  time.  If  the  cam- 
era motion  is  further  restricted  to  continuously  fixate  on  a point,  we  show  how  the 
equal-flow  circles  can  be  used  to  quantitatively  analyze  the  space  and  in  particular  the 
neighborhood  of  the  fixation  point.  In  a set  of  simulation  as  well  as  real-data  experi- 
ments we  show  how  the  concept  of  the  Equal  Flow  Circle  (EFC)  and  Zero  Flow  Circle 
(ZFC)  can  be  used  to  explain  the  optical  flow  produced  by  points  near  the  fixation 
point,  how  the  optical  flow  of  points  on  a ZFC  disappear  at  a time  instant,  and  how 
EFCs  and  ZFCs  can  be  used  to  explicitly  map  the  space  while  fixating. 

Previous  work  in  the  area  of  camera  fixation  has  been  mainly  in  the  following 
categories:  (1)  fixation  for  qualitative  depth  estimation  [4],  (2)  fixating  on  a moving  tar- 
get for  tracking  applications  [2],  and  (3)  stereo  fixation  for  vergence  control  [4],[6]. 
Surprisingly,  little  previous  work  that  leads  to  a quantitative  analysis  of  single  camera 
fixation  has  been  done  [1],[7].  Cutting  [7]  did  an  analysis  of  camera  fixation.  We  use  a 
different  analysis  approach  than  he  used,  and  our  results  are  an  extension  and  elabora- 
tion of  the  results  he  obtained. 

2.  EQUATIONS  OF  MOTION  AND  OPTICAL  FLOW 

This  section  describes  the  equations  that  relate  a point  in  3-D  space  to  the  projec- 
tion of  that  point  in  the  image  for  general  six-degree-of-freedom  motion  of  the  camera. 
Some  of  the  equations  can  be  found  in  many  books,  e.g.,  see  [10]. 

In  the  following  analysis,  we  assume  a moving  camera  in  a stationary  environ- 
ment. Suppose  the  coordinate  system  is  fixed  with  respect  to  the  camera  as  shown  in 
Figure  1.  Assume  a pinhole  camera  model  and  that  the  pinhole  point  of  the  camera  is 
at  the  origin  of  the  coordinate  system.  We  derive  the  optical  flow  components  in  the 
spherical  coordinates  (/?04)).  In  this  frame,  angular  velocities  (0  and  <j))  of  any  point  in 
space,  say  P,  are  identical  to  the  optical  flow  values  at  P’  in  the  image  domain.  Figure 
2 illustrates  this  concept:  0 and  0 of  a point  in  space  are  the  same  as  0 and  4)  of  the  pro- 
jected point  P’  in  the  image  domain,  and  therefore  there  is  no  need  to  convert  angular 
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velocities  of  points  in  3D  space  to  optical  flow.  In  Figure  2 the  image  domain  is  a 
sphere.  However,  for  practical  purposes  the  surface  of  the  image  sphere  can  be  mapped 
onto  an  image  plane  (or  other  surface).  This  choice  is  also  good  from  an  implementa- 
tion point  of  view.  The  spherical  coordinate  system  is  a natural  firame  to  work  with 
when  a camera  is  mounted  on  a two  degree  of  freedom  rotating  frame  (whose  angles 
can  be  expressed  as  Euler  angles). 

We  start  with  the  derivation  of  the  velocity  of  a 3-D  point  in  the  XTL  coordinates 
(Figure  1).  Let  the  instantaneous  coordinates  of  the  point  P be  R = (X,y,Z)^  (where  the 
superscript  T denotes  transpose).  If  the  instantaneous  translational  velocity  of  the  cam- 
era is  t = (Uy,W)^  and  the  instantaneous  angular  velocity  is  ta  = (A ^ ,cY  then  the  velo- 
city vector  V of  the  point  P with  respect  to  the  XYZ  coordinate  system  is: 


V = -t-(DxR  (1) 

or: 

Vx  = -U-BZ^CY  (2) 

Vy  =-V-CX+AZ  (3) 

Vz  = -W-AY^BX  (4) 


where  and  Vz  are  the  components  of  the  velocity  vector  V along  the  X,  y,  and  Z 

directions  respectively. 

To  convert  from  RQ<\>  to  XYZ  coordinates  we  use  the  relations: 


X = R cos4>  COS0 
Y = R cos<j>  sin0 
Z = R sin()>. 


(5) 

(6) 
(7) 


Similarily,  to  convert  from  xyz  to  R 0(1)  coordinates  we  use: 
R = Vx^+y^+z^ 

e = tan-| 


(8) 

(9) 

(10) 


In  order  to  find  the  optical  flow  of  a 3-D  point  in  R 0<t)  coordinates,  we  use  the  follow- 
ing relations  and  transformations  (See  [11]  and  Figure  1): 

Let  Vg , Ve,  and  be  the  components  of  the  vector  V in  spherical  coordinates,  and 


V^e 


(11) 
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Kxyz  - 


Vy 

Vz 


Then: 


where 


^J(e^  = [^^][7'0]Vxyz 


[7'0]  = 


COS0  sin0  0 
-sin0  COS0  0 
0 0 1 


V3F+F 

-y  X 


VP+F  VF+F 

0 0 1 


and 


[T^]  = 


cos4>  0 sin<j) 
0 1 0 
-sin(|)  0 cos<}> 


Vx^y^  n 
Vx^+y^+z^  VF+F+F 
0 1 0 


-z  ^ Vx^+y^ 
VFiF+F  VF+F+F 


Also  (see  [11]): 

VOf  =/? 

V"0  = /?0  cos<j> 

V0  = i?<i) 

where  dot  denotes  first  derivative  with  respect  to  time. 

Using  equations  (2)-(18)  yields  the  following  expressions: 


RQ  cos4> 

r 

- sin0 


COS0 


0 


-U-BZ+CY 

-V-CX+AZ 

-W-AY+BX 


or 


-y 

X 

0 

x2+y2 

x2+y2 

0 

-U-BZ+CY 

.‘i*. 

= 

-xz 

-yz 

>/F+F 

-V-CX+AZ 

rW-AY+BX_ 

1 

N 

Vx^+y^(x2+y2+z2) 

x^+y^+z^ 

(12) 


(13) 


(14) 


(15) 


(16) 

(17) 

(18) 


(19) 


(20) 


As  mentioned  earlier,  0 and  (>  of  a point  in  space  (i.e.,  the  angular  velocities  in  the 
camera  coordinate  system)  are  the  same  as  the  optical  flow  components  0 and  4)  (Figure 
2). 
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Suppose  that  we  want  to  determine  the  locus  of  points  in  3D  space  that  produce 
constant  optical  flow  values  0 and  constant  optical  flow  values  4>  in  the  image  for  a 
given  arbitrary  six-degree-of-freedom  camera  motion.  To  do  so  we  simply  set  0 and  0 
in  equation  set  (20)  to  the  desired  constants  and  solve  for  X,  y,  and  Z.  All  points  in 
3-D  space  that  satisfy  this  solution  are  called  Equal  Row  Points.  However,  the  solu- 
tion to  these  two  equations  is  not  unique  since  there  are  three  unknowns  and  two  equa- 
tions. In  general,  there  is  an  infinite  number  of  solutions. 

4.  A SPECIAL  CASE 

In  this  section  we  analyze  a specific  motion  in  the  instantaneous  XY  (<|)=0)  plane  of 
the  camera  coordinate  system.  Later  we  use  this  analysis  for  the  case  where  the  cam- 
era fixates  on  a single  point  in  space. 

Let  the  camera  motion  vectors  t and  to  be  given  as  follows: 

t = (C/y.O)^  (21) 

(0  = (0,0,0^.  (22) 


This  means  that  the  translation  vector  may  lie  anywhere  in  the  instantanous  XY  plane 
while  the  rotation  is  about  the  Z axis.  Substituting  these  motion  vectors  into  equation 
set  (20)  yields: 


0 

0 


-Y 

x2+y2 

-xz 

Vx2+y2(x2+y2+z^ 


X 

x2+y2 

-yz 

Vx2+y^(x2+y2+z2) 


0 

vx^+y^ 

x^+yVz^ 


-c/+cy 
-v~cx 
. 0 . 


(23) 


Setting  0 and  ^ in  equation  set  (23)  to  constants  will  result  in  a set  of  equal  flow  points 
for  this  specific  motion. 

4.1  EQUAL  FLOW  CIRCLES 


For  visualization  purposes,  we  decided  to  examine  the  case  where  the  optical  flow 
value  of  0 is  constant  and  the  optical  flow  value  of  ^ is  zero.  From  equation  set  (23), 
the  points  in  space  that  result  from  constant  0 (regardless  of  the  value  of  ^)  form  a 
cylinder  of  infinite  height  whose  equation  is 


'\2 


x+ 


2(C+0) 


y- 


u 


2(C+0) 


2(C+0) 


U 


2(C+0) 


as  displayed  in  Figure  3 a,  and  the 


points  in  space  that  result  from  (i>=0  (regardless  of  the  value  of  0)  are  those  that  lie  on 


(a)  a plane  whose  equation  is  y=-  -^X,  or  (b)  a plane  whose  equation  is  Z=0  (i.e.,  the 


XY  plane)  as  pictorially  described  in  Figure  3b.  The  intersection  of  the  cylinder  with 
the  planes  is  the  desired  solution  (Figure  3c),  i.e.,  the  points  in  space  that  result  in 
Q=constant  and  (i)=0  optical  flow  values.  Analytically,  the  following  are  the  solutions 
(disallowing  the  case  of  X=0  and  y=0  which  corresponds  anomalous  situation): 
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Z =0 

X =- 


Yi  ^ 

2 

y ^ 

2 

y 

2 

* •« 

u 

2(C+0) 

k * 

+ 

2(C+0) 

k.  J 

2(C+0) 

k.  J 

2(C+0) 

and  Y = 

C +6  C +0 


(24) 

(25) 


These  solutions  are  drawn  in  Figure  4.  Solution  (24)  is  an  equation  of  a circle  that  lies 

_i_ 

2 


in  the  xy  plane.  The  radius  of  the  circle  is 


V 

2 

V 1^ 

2(C+0) 

-L  J 

2(C+0)J  _ 

and  its  center  is  at 


V 


U 


2(C+0)  2(C+e) 


The  circle  is  tangent  to  the  camera  translation  vector  at  the  ori- 


dY 


gin.  This  can  be  shown  as  follows:  the  slope  — of  a tangent  to  the  circle  at  any  point 

CU^ 


IS 


dX 


x+ 


2(c+e) 


Y- 


u 


■.  At  the  origin,  this  takes  the  value  — , which  is  the  same  as  the 


2(C+0) 

slope  of  the  translation  vector  t. 


Solution  (25)  is  a straight  line  perpendicular  to  the  XY  plane  and  intersects  this 
V U 


plane  at  the  point 


C+0  C+0 


.0 


. This  intersection  point  also  lies  on  the  circle 


defined  in  solution  (24). 


The  meaning  of  these  solutions  is  the  following:  all  points  in  3-D  space  that  lie  on 
the  circle  or  the  line  described  by  solutions  (24)  and  (25)  and  which  are  visible  (i.e., 
unoccluded  and  in  the  field  of  view  of  the  camera)  produce  the  same  instantaneous 
optical  flow  0 and  zero  instantaneous  optical  flow  0.  We  call  the  circle  on  which  equal 
flow  points  lie  the  Equal  Flow  Circle  (EFC).  Two  sets  of  EFCs  are  illustrated  in  Fig- 
ure 5.  Figure  5a  shows  EFCs  for  the  case  where  the  camera  undergoes  instantaneous 
translation  only.  The  label  of  each  circle  represents  the  optical  flow  0 in  the  image  that 
corresponds  to  points  on  this  circle.  Here,  there  is  a straight  line  (a  circle  with  an 
infinite  radius)  that  corresponds  to  zero  flow  in  the  image.  Figure  5b  shows  EFCs  for 
the  case  where  the  camera  undergoes  instantaneous  translation  and  rotation.  Here,  there 
is  a circle  with  finite  radius  that  produces  zero  flow  (0  = 0 in  the  image  domain). 


4.2  ZERO  FLOW  CIRCLES 


One  of  the  EFCs  corresponds  to  points  in  3-D  space  that  produce  zero  flow.  We 
call  this  circle  Zero  Flow  Circle  (ZFC)  [13].  The  equation  that  describes  the  ZFC  can 
be  obtained  by  setting  0=0  in  equation  (24)  i.e., 

'\7,  f *^2^  ^2 


Z = 0 and 


+ 


Y- 


U 

1C 


W 

1C 
% * 


(26) 


If  the  Z component  of  the  camera  rotation  vector  o)  is  positive  (i.e.,  C>0),  then  visible 
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points  in  the  xy  plane  that  are  inside  the  ZFC  produce  positive  optical  flow  (0>O),  while 
visible  points  outside  the  ZFC  produce  negative  optical  flow  (e<0)  in  the  image  (see 
Figure  6).  This  can  be  shown  as  follows.  The  points  that  are  inside  the  ZFC  satisfy 


^ V 

2 

T,  U 

2 

V 

2 

u 

X 

2C 

k J 

+ 

< 

2C 

i.  J 

+ 

2C 

L,  J 

Given  the  constraint  in  (27),  then  for  C>0,  equation  (24)  is  satisfied  if  and  only  if  e>0. 
A similar  discussion  holds  for  C<0. 

4.3  THE  EFCs  and  ZFCs  AS  A FUNCTION  OF  TIME 

As  the  camera  moves  through  3-D  space,  the  EFCs  move  with  it.  Figure  7 is  an 
example  of  a camera  path  with  some  EFCs.  At  each  instant  of  time,  the  radii  of  the 
EFCs  are  a function  of  the  instantaneous  motion  parameters  t and  co.  The  locations  of 
the  EFCs  are  such  that  they  always  contain  the  origin  of  the  camera  coordinate  system 
(the  same  as  the  camera  pinhole  point),  are  tangent  to  the  instantaneous  translation  vec- 
tor t,  and  are  perpendicular  to  the  instantaneous  rotation  vector  co.  Each  ZFC  lies  to  the 
left  or  right  of  the  translation  vector  depending  on  whether  the  instantanous  rotation  is 
positive  or  negative,  respectively.  A simpler  case  is  detailed  in  Figure  8,  where  we 
assume  motion  along  a straight  line  with  constant  speed  v*.  Figure  8a  shows  a camera 
that  undergoes  translation  only.  The  optical  flow  of  the  four  points  A,  B,  C,  and  D as 
a function  of  time  is  shown  in  Figure  8c.  The  vertical  coordinate  is  the  optical  flow  0 
and  the  horizontal  coordinate  is  time.  At  time  t=t2,  the  points  A,B,C,  and  D produce 
the  same  optical  flow  (optical  flow  graphs  of  all  the  four  points  in  Figure  8c  intersect) 
and  thus  appear  on  the  same  instantaneous  EFC  (as  shown  in  Figure  8b). 

4.4  EFCs,  ZFCs,  and  FDCATION 

If  the  point  on  which  the  camera  fixates  is  visible  in  the  image,  then  the 
corresponding  image  point  will  have  zero  optical  flow  during  fixation.  However,  at  a 
specific  time  instant,  a fixation  point  is  one  out  of  many  that  may  produce  zero  optical 
flow.  For  motion  in  an  instantaneous  XY  plane,  as  described  previously,  these  points  lie 
on  a circle  and  a line.  Since  points  inside  the  circle  produce  flow  values  of  opposite 
sign  to  those  outside  the  circle,  a point  in  3-D  space  which  is  not  the  fixation  point 
may  produce  different  flow  values  at  different  instants  of  time. 

By  definition,  a fixation  point  (if  visible)  produces  zero  optical  flow  at  all  instants 
of  time  during  the  motion.  If  the  fixation  point  lies  in  the  instantaneous  XY  plane,  then 
the  ZFC  at  each  instant  of  time  must  contain  the  fixation  point.  (There  are  special  cases 
in  which  more  than  one  fixation  point  exists.) 

The  fixation  point  is  the  intersection  of  all  the  ZFCs. 

In  Figure  9 we  analyze  the  case  where  a camera  fixates  while  translating  in  a 
straight  line.  Assume  that  the  translational  velocity  V*  is  a positive  constant.  I.-et  us 
consider  the  optical  flow  due  to  a point  other  than  the  fixation  point.  Figures  9a  shows 
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the  fixation  point  F and  an  arbitrary  point  A,  and  their  positions  relative  to  the  camera. 
Five  instants  of  time  have  been  chosen  to  explain  the  optical  flow  due  to  point  A. 

Let  and  0^  be  the  angles  of  points  F and  A,  respectively,  in  the  camera  coordi- 
nate system.  Then: 

• For  t <ti,  point  A lies  outside  the  instantaneous  ZFC  (Figure  9b),  (0a- Qf)  is 
negative  and  a strictly  decreasing  function  (Figure  9c),  and  the  optical  flow  of  that 
point  0A  (which  also  equals  (0a-  Qf)  because  0/r=  0)  is  negative  (Figure  9d). 

• At  t = ti,  point  A lies  on  the  instantaneous  ZFC  (Figure  9b),  (0a-  Of)  is  negative 
(Figure  9c),  and  the  optical  flow  0a  is  zero  (Figure  9d). 

• For  ti  < t < t2,  point  A lies  inside  the  instantaneous  ZFC  (Figure  9b),  (0a-  Qf)  is 
negative  (Figure  9c),  and  the  optical  flow  0^  is  positive  (Figure  9d). 

• At  r = t2»  point  A lies  inside  the  instantaneous  ZFC  (Figure  9b),  (0a-  0f ) is  zero, 
i.e.,  point  A lies  on  the  optical  axis  in  front  of  the  fixation  point  (Figure  9c),  and  the 
optical  flow  0^  is  positive  (Figure  9d). 

• For  t2<t<  t4,  point  A lies  inside  the  instantaneous  ZFC  (Figure  9b),  (0a-  Qf)  is 
positive  (Figure  9c),  and  the  optical  flow  0a  is  positive  and  gets  its  maximum  value  at 

(Figure  9d). 

• At  r = ^4,  point  A lies  on  the  instantaneous  ZFC  (Figure  9b),  (0a-  Bf)  is  positive 
(Figure  9c),  and  the  optical  flow  0^  is  zero  (Figure  9d). 

• For  t > r4,  say  t = ts,  point  A lies  outside  the  instantaneous  ZFC  (Figure  9b), 
(0A-  Bf)  is  positive  and  a strictly  decreasing  function  (Figure  9c),  and  the  optical  flow 
0A  is  negative  (Figure  9d).  In  fact,  as  <»,  approaches  zero. 

The  point  A is  inside  instantaneous  ZFCs  during  the  open  time  interval  (tj  , t^).  In 
this  period  of  time  it  seems  to  the  viewer  that  it  "moves  to  the  left".  During  the  inter- 
vals (- «» , ti)  and  (f4 , oo)  the  point  seems  to  be  "moving  to  the  right".  No  relative 
motion  is  detected  at  ti  or 

Figure  10  shows  EFCs  during  fixation  at  two  different  time  instants.  At  time 
instant  the  angular  velocity  of  the  camera  is  C=  Ci,  and  at  time  instant  ^2  it  is  C=  C2. 
The  location  of  an  EFC  at  a particular  time  instant  can  be  obtained  analytically  from 
equation  (24).  However,  for  fixated  motion  the  relationship  between  the  radius  and  the 
corresponding  angular  velocity  of  an  EFC  can  be  simply  obtained  by  subtracting  the 
instantaneous  angular  velocity  of  the  camera  from  the  angular  velocity  of  EFCs  of  a 
"translating  only"  camera.  For  example,  at  time  ti  the  angular  velocity  (or  the  0)  of  the 
ZFC  is  C]-Ci=0,  the  0 that  corresponds  to  a circle  whose  radius  is  half  the  ZFC’s 
radius  is  2Ci-Ci=Ci,  the  0 that  corresponds  to  a circle  whose  radius  is  one  fourth  the 
ZFC’s  radius  is  4Ci-Ci=3Ci,  etc.  Similarly  we  can  analyze  circles  at  other  time 
instants. 
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4.6  MAPPING  THE  SPACE  WHILE  FIXATING 


The  EFCs  can  be  described  in  a more  generalized  form,  using  ratios  between  the  0 

6 

of  each  circle  to  the  rotation  parameter  C,  i.e.,  — . For  example  (see  Figure  10),  a cir- 

cle  which  is  inside  the  ZFC  and  whose  radius  is  half  the  ZFC’s  radius,  has  a normal- 

6 

ized  angular  velocity  (or  optical  flow  0)  — of  1.  Figure  11a  shows  EFCs  with  normal- 
0 

ized  values  of  — . Obviously,  the  normalized  value  of  the  ZFC  is  0.  Figure  lib  shows 
normalized  EFCs  during  fixation. 

Using  the  EFC  (or  the  normalized  EFC)  concept  it  is  possible  to  quantitatively 
map  the  space  in  such  a way  that  any  point  on  the  XY  plane  can  be  located. 

The  method  is  based  on  relative  mapping.  Given  (only)  the  ratio  between  the  opt- 

9 

ical  flow  0 of  a point  and  the  camera  rotation  parameter  C,  — (assuming  C^O),  and  the 

projection  of  the  point  in  the  image  (i.e.,  0 and  (>),  then  the  location  of  the  point  relative 
to  the  fixation  point  (or  relative  to  the  camera)  can  be  obtained.  The  instantaneous 
direction  of  motion  of  the  camera  should  be  known  (can  be  obtained  by  searching  in 

the  image  for  a point  that  produces  77=-!  (Figure  11a),  and  (M)-  Refer  to  Figure  12: 

After  locating  the  instantaneous  direction  of  motion  0,,  the  location  of  normalized  EFCs 

0p 

m camera  coordinates  can  be  deterrmned.  — determines  the  location  of  the  normal- 
ized EFC  on  which  the  point  P is  located  relative  the  ZFC.  The  angle  (0p  - 0,)  deter- 
mines the  exact  location  of  the  point  on  that  EFC  relative  to  the  instantaneous  direc- 
tion of  motion  (Figure  12a). 

Figure  12b  is  a suggestion  for  a more  elegant  mapping.  This  mapping  consists  of 
two  orthogonal  families  of  circles.  One  family  is  the  EFCs.  A point  can  be  mapped 
relative  to  the  fixation  point  by  specifying  two  numbers  that  are  derived  from  the  opti- 
cal flow  (they  specify  two  orthogonal  circles)  [15]. 

5.  EXPERIMENTAL  RESULTS 

We  performed  three  sets  of  experiments  to  test  the  theory  of  EFCs  and  ZFCs. 

5.1.  SYNTHETIC  DATA 


In  this  set  of  experiments  we  tested  the  concept  of  the  EFC  using  a computer 
simulation  of  a camera  that  fixates  on  a point  while  translating  in  a straight  line.  The 
simulation  program  finds  the  optical  flow  0 of  points  in  the  XY  plane  and  assigns  a 
color  to  each  value  of  flow.  Figure  13  shows  the  results.  Each  circle  corresponds  to  a 
different  value  of  0.  The  Fixation  point  is  always  on  the  instantaneous  ZFC.  Other 
points  (e.g.,  the  center  of  the  white  square)  may  be  inside  (Figure  13a),  on,  or  outside 
(Figure  13b)  the  instantaneous  ZFC.  This  figure  is  the  flow  map  for  only  two  time 
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instants.  However,  we  produced  an  animation  movie  that  shows  these  circles  dynami- 
cally expanding  and  contracting  during  fixation. 

5.2.  REAL  DATA 

This  set  of  experiments  were  used  to  test  the  theory  of  ZFCs  with  real  data,  and 
involved  linear  camera  translation  under  fixation.  We  predicted  qualitative  values  for 
optical  flow  based  on  ZFC  analysis,  and  compared  it  with  actual  flow  values  obtained 
during  experimentation.  In  all  cases,  the  actual  flow  values  are  consistent  with  the 
predicted  values. 

We  examined  three  fixation  scenarios.  All  three  experiments  involved  the  same 
camera  motion  and  the  same  objects  in  the  scene.  However,  the  configuration  of  the 
objects  relative  to  the  camera  translation  motion  path  was  different  in  the  three  experi- 
ments. Three  different  objects  were  placed  colinearly  on  a table.  The  camera  motion 
involved  a constant  velocity  translation  with  fixation  on  the  middle  object.  The  experi- 
mental scenarios  and  the  results  are  shown  in  Figure  14  and  are  described  in  more 
detail  below. 

For  each  experiment,  the  imagery  at  a single  scan  line  4>=0  of  the  camera  was 
recorded  as  a function  of  time  [5[,[12].  This  scanline  is  the  projection  of  the  XY  plane. 
(The  camera  scanline  was  parallel  to  the  table  top  at  all  times.)  Each  experiment  thus 
resulted  in  a spatio-temporal  image  for  the  given  scan  line.  The  horizontal  coordinate 
of  such  an  image  represents  time  for  successive  frames  of  the  same  scan  line,  and  the 
vertical  coordinate  represents  the  pixels  spatial  positions  on  the  scan  line.  These  images 
are  shown  also  in  Figure  14,  and  are  described  in  more  detail  below.  In  each  case  the 
fixated  object  is  the  darker  horizontal  line  in  each  image,  while  the  other  two  curves 
belong  to  the  other  objects.  The  optical  flow  is  the  time  derivative  of  each  curve,  or 
the  slope  of  the  curves  in  time-space  domain. 

Experiment  1^  (Figure  14a) 

In  this  experiment  the  three  objects  (Al,  A2,  and  the  fixation  point)  lie  on  a line 
parallel  to  the  direction  of  camera  translation  path.  The  points  Al  and  A2  produce  opt- 
ical flow  that  is  changing  as  a function  of  time.  There  is  one  place  for  each  point  where 
there  is  a change  in  the  optical  flow  sign.  This  is  due  to  a change  in  relative  location 
between  the  points  and  the  ZFC^.  First  (r=/i),  the  point  Al  is  inside  the  ZFC  (produc- 
ing positive  0 optical  flow)  and  the  point  A2  is  outside  the  ZFC  (negative  0 flow). 
Then  (1=12),  the  point  Al  is  on  the  ZFC  (zero  flow)  and  A2  is  still  outside  the  ZFC. 
When  the  camera  is  perpendicular  to  the  direction  of  translation  0=^3)  Al  and  A2  are 
outside  the  ZFC  (negative  0 flow).  Later  (^=^4),  The  point  Al  is  outside  the  ZFC  (nega- 
tive 0 flow)  and  the  point  A2  is  on  the  ZFC  (zero  flow).  Finally  U=ts)  Al  is  outside 
the  ZFC  (negative  0 flow)  and  A2  is  inside  the  ZFC  (positive  0 flow). 
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Experiment  ^ (Figure  14b) 

In  this  experiment  the  three  objects  (A3,  A4,  and  the  fixated  object)  lie  on  a line 
perpendicular  to  the  direction  of  camera  translation.  First  at  t<t2  (say  f=  tj),  A4  is 
inside  the  ZFC  (positive  0 flow)  and  A3  is  outside  it  (negative  0 flow).  Then  (1=12), 
A4  is  on  the  ZFC  (zero  flow)  and  A3  is  outside  the  ZFC  (negative  0 flow).  For  t2<t<tj 
A3  and  A4  are  outside  the  ZFC  (negative  0 flow).  Then  at  (^=^3)  A3  is  on  the  ZFC 
(zero  flow)  and  A4  is  outside  the  ZFC  (negative  0 flow).  Later  (^=^4),  A3  stays  inside 
the  ZFC  (positive  0 flow)  while  A4  is  outside  the  ZFC  (negative  0 flow).  At  t = the 
ZFC  gets  its  minimum  diameter  (compared  to  other  ZFCs  during  the  same  motion). 
Similarly,  we  can  continue  to  analyze  the  time  instants  after  ^4.  Note  that  in  this  case 
each  point  changes  the  direction  of  its  corresponding  optical  flow  twice  due  to  two 
passes  through  ZFCs.  The  Zero  Flow  Points  are  marked  (two  for  A3,  and  two  for 
A4). 

Experiment  3^  (Figure  14c) 

In  this  case  we  examine  a more  general  case.  The  points  A5  and  A6  lie  on  a line 
that  is  not  parallel  nor  perpendicular  to  the  direction  of  the  camera  direction.  Here,  as 
in  experiment  2,  for  each  point  there  are  two  changes  in  the  sign  of  the  optical  flow 
that  can  be  explained  using  the  ZFCs.  Due  to  experimental  limitations  only  one  change 
for  each  point  is  seen. 

5.3  A ZFC  EXPERIMENT 

Refer  to  Figure  15.  We  examined  the  ZFC  theory  in  one  more  way.  For  a camera 
undergoing  linear  translation  while  fixating  on  a point,  we  set  up  a circle  of  toothpicks 
on  the  table  top.  The  circle  was  tangent  to  the  line  of  camera  motion.  When  a point  on 
this  circle  was  chosen  as  the  fixation  point,  we  verified  that  at  the  instant  the  camera 
passes  the  tangent  point,  the  optical  flow  of  all  points  on  the  circle  become  zero.  Fig- 
ure 15a  shows  a portion  of  this  circle.  The  image  at  some  time  instant  is  shown  in 
Figure  15b.  Figure  15c  shows  one  scan  line  of  the  image  in  Figure  15b  as  a spatio- 
temporal  image.  The  horizontal  line  in  this  time-space  image  corresponds  to  the 
fixation  point,  since  it  does  not  change  its  vertical  location  as  a function  of  time  (i.e., 
produces  zero  optical  flow).  The  optical  flow  of  other  points  (change  in  their  vertical 
location  over  time)  changes  sign.  At  some  time  instant  (approximately  the  central  hor- 
izontal line  of  the  time-space  image)  they  produce  no  optical  flow.  At  this  instant  of 
time  these  points  lie  on  a circle  that  includes  the  pinhole  point  of  the  camera.  This  cir- 
cle is  the  ZFC.  Using  a program  that  extracts  optical  flow  of  points  using  gradient 
methods  [12]  we  displayed  the  optical  flow  images  at  several  time  instants.  Figures 
15d,  e,  and  f show  the  evolution  of  the  optical  flow  of  the  points  on  the  circle.  In  Fig- 
ure 15d  the  camera  staned  to  move  and  there  is  optical  flow  from  most  points.  In  Fig- 
ure 15e  the  points  near  the  fixation  point  produce  small  values  of  optical  flow.  Figure 


-12- 


15f  depicts  the  situation  just  before  the  camera  arrives  at  the  tangent  point.  When  the 
camera  is  exactly  at  the  tangent  point,  all  optical  flow  values  become  zero. 

A videotape  (for  presentation  only)  shows  this  experiment  continuously. 

6.  DISCUSSION 

In  this  paper  we  present  a quantitative  way  for  analyzing  fixation.  Using  the  con- 
cept of  EFCs  it  is  possible  to  locate  points  in  space  relative  to  the  fixation  point,  and 
explain  the  behavior,  e.g.,  direction  of  optical  flow,  of  points  near  the  fixation  point  as 
a function  of  time.  The  camera’s  instantaneous  direction  of  translation  and  the  fixation 
point  determine  the  plane  on  which  the  EFCs  can  be  found.  We  show  that  points  on  an 
EFC  inside  the  ZFC  produce  optical  flow  that  is  opposite  in  sign  to  that  produced  by 
points  outside  the  ZFC.  (When  a point  in  space  crosses  a ZFC  it  produces  zero  flow.) 

For  explanation  purposes  we  analyzed  a special  case  of  motion.  However,  a simi- 
lar approach  (though  it  could  be  more  difficult  to  visualize  the  results)  can  be  taken  for 
a more  general  motion  of  the  camera.  The  analysis  for  the  current  motion  can  also  be 
extended  to  find  equal  flow  curves,  i.e.,  curves  that  correspond  to  constant  0 and  con- 
stant (^,  or  curves  that  correspond  to  constant  / (G.cj))  where  / (.)  is  a function  of  0 and  (j). 

The  coordinate  system  that  we  chose  is  a convenient  one.  However,  the  angular 
velocities  of  points  in  space  are  independent  of  their  representation  in  the  image.  Other 
image  coordinate  systems  may  be  chosen,  in  particular,  (for  practical  purposes)  the 
image  domain  may  be  planar.  (Obviously,  an  appropriate  conversion  from  the  spherical 
coordinate  system  should  be  used). 

This  analysis  complements  the  qualitative  understanding  of  fixation:  It  shows  that 
a point  that  is  not  the  fixation  point  may  change  its  optical  flow  sign,  and  is  not  res- 
tricted to  "moving  to  the  right  (or  to  the  left)"  as  has  commonly  been  assumed. 

In  this  paper  we  emphasized  camera  fixation  without  mentioning  eye  fixation. 
However,  the  theory  that  has  been  developed  is  independent  of  the  visual  sensing  dev- 
ice, and  thus  it  is  suitable  for  eye  fixation  as  well.  The  EFCs  can  be  thought  as  proper- 
ties of  space  rather  than  properties  of  points  in  the  image  domain. 

7.  FUTURE  WORK 

Currently,  other  cases  of  equal  flow  points  are  being  investigated.  Also,  the  map- 
ping described  in  section  4.6  is  being  extended  to  3D.  We  examine  other  cases  of 
camera  motion  where  the  rotation  vector  is  not  perpendicular  to  the  translation  vector. 
We  plan  to  exploit  the  EFCs  (and  their  extensions)  concept  in  a vision  based  navigation 
algorithm  for  a real-time  robot  system. 
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Figure  1:  Coordinate  system  fixed  to  camera 
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(b) 


(c) 


(b)  ^=0  planes 

(c)  Intersections  between  0 cylinders  and  4>=0  planes 
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Figure  4:  Pictorial  description  of  solutions  (24)  and  (25) 


Figure  5:  Optical  flow  values  due  to  camera  motion 

(a)  for  translation  only 

(b)  for  translation  and  rotation 
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Figure  6:  Optical  flow  signs  inside  and  outside  the  ZFC 


Figure  7:  EFCs  as  a function  of  time 
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Figure  8:  Optical  flow  and  EFC 

(a)  translating  camera  ^^'g^re  9:  Fixation  and  the  ZFCs 

(b)  an  EFC  fixating  camera 

(c)  optical  flow  as  a function  of  time  (fi)  ZFCs  during  fixation 


Figure  11:  Normalized  EFCs 

(a)  at  a time  instant 

(b)  during  fixation 
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Figure  12:  Mapping  the  XY  plane  using 

(a)  EFCs  and  angles 

(b)  EFCs  and  their  orthogonal  circles 
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Figure  13:  Results  of  simulated  EFCs  during  fixation 
at  two  different  locations  of  the  camera 
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Figure  14a:  Results  in  time-space  domain 
for  points  A],  A 2,  and  F 
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Figure  14b:  Results  in  time-space  domain 
for  points  A3,  A 4,  and  F 
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Figure  14c:  Results  in  time-space  domain 
for  points  A 5,  A 5,  and  F 
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^ Figure  15:  ZFC  experiment 

(a)  setup 

(b)  camera’s  view  at  a time  instant 

(c)  results  in  time-space  domain 

(d) -(f)  optical  flow  at  three  time  instants 
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